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DIGITAL IMAGING 
Background of the Invention 

The present invention relates to digital imaging technology, and more 
particularly to contrast and edge enhancement in still and moving digital 
imaging. 

Digital imaging offers a great many advantages over traditional analogue 
10 techniques, supporting services such as video telephony and multi-media 
applications. Accordingly, digital imaging is currently the subject of extensive 
research. 

One particular area of digital imaging research is that of image enhancement. 

15 In digital imaging, there is need for image enhancement because images 
typically suffer from various types of degradation, such as lack of sharpness, 
noise, compression artefacts, and poor contrast and brightness. Mobile 
imaging products presently under development are especially prone to such 
degradations due to the low performance of current digital camera devices 

20 and the narrow data transmission bandwidth typically available in mobile 
communications networks, which requires the use of high compression ratios. 
In digital camera products, poor image quality arises from shortcomings in 
fundamental sensor properties. The lack of contrast typically arises from the 
sensor itself, while the lack of sharpness is the result of both low quality optics 

25 and low sensor resolution. Low resolution sensors are likely to be used in the 
imaging systems of forthcoming first generation mobile telecommunication 
terminals with image presentation and manipulation functionality. Thus, there 
is a need for methods to enhance image contrast and sharpness, and in 
current digital image enhancement techniques this is commonly carried out by 

30 concealing artefacts and reconstructing degraded parts of an image. 
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Image enhancement principally concerns accentuation of image features such 
as edges, boundaries, or contrast. This makes image details more visible and 
makes images look subjectively sharper or crisper without appearing 
unnatural, therefore making a graphic display more useful for display and 
5 analysis. Whilst the enhancement process does not increase the inherent 
information content in the data, it does increase the dynamic range of chosen 
features so that they can be more easily detected. 

Image enhancement techniques can be divided roughly into three sub-classes 
10 comprising point, spatial, and transform operations. 

Point operations are performed on individual pixels and as such are 
independent of surrounding pixel values. Pixel mapping operations are one 
example of point operations. Pixel mapping involves mapping a pixel value to 
a new value with a function, for example: 

y,j = /(*,-.>). 

where 

i, j = pixel's coordinates 
y = output pixel 
x = input pixel 

and f is a function relating xand y. 

20 Spatial operations are performed on groups of pixels. Certain image 
smoothing and filtering functions are spatial operations where, for example, a 
pixel's value may be modified by taking an average of surrounding pixel 
values. 

25 Transform operations convert image data from pixel values into another form, 
for example spatial frequency components. Discrete cosine transforms (DCT) 
and wavelet transforms are examples of transform operations commonly used 
in image processing applications. 
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Examples of enhancement techniques in the sub-classes outlined above 
include techniques such as grey level and contrast manipulation, noise 
reduction, edge crispening and sharpening, filtering, interpolation and 
magnification, and pseudo-colouring. 

5 

In practice, images taken by a digital camera normally suffer from smoothness 
problems irrespective of the pixel resolution. This means that there is always 
likely to be a need for image sharpening techniques. Image sharpening can 
be performed by applying various forms of contrast enhancement (stretching / 

10 shrinking) and edge enhancement techniques. Contrast enhancement is a 
point operation that can be used to enhance images taken in poor or non- 
uniform lighting conditions, or acquired with an imaging sensor having a small 
dynamic range. Contrast manipulation also tends to alter the visibility of 
edges, which changes the perceived sharpness of the image. Edge 

15 enhancement techniques are typically spatial operations and they enhance 
images that suffer from overall smoothness. A technique known as unsharp 
masking is an example of an edge enhancement technique. 

Referring first to contrast enhancement, a well known method for enhancing 
20 contrast is histogram-based pixel mapping. In this method a pixel-mapping 
function is formed utilising a histogram of the image, or a part of an image. 
The histogram contains the number of pixel occurrences at each level of the 
input signal range. The mapping function is derived from a cumulative 
histogram so that it has high slope corresponding to high values in the 
25 histogram. The cumulative histogram is typically formed using an equation 
having the form: 

k=0 

where 

C, = bin i of cumulative histogram 
H k — bin k of histogram 




Note that a bin is a pixel value range, that may cover a single pixel value or 
more than one pixel value. 



In the basic method the mapping function is: 

5 

/(*) = C X 

The mapping function or the cumulative histogram is typically scaled so that 
P the mapping covers substantially exactly the available dynamic range, i.e.: 

fi 10 

i f(L) = L, 

\Z where 

q 

jjff L = largest value of the available dynamic range 

mi 

w The scaling is achieved, for example, using equation: 

« c 

w 15 f( x ) = L—Z- 

The above equations can be found in slightly varying forms in many signal 
processing textbooks. For example, in one alternative approach the first 
nonzero bin is subtracted from the histogram before or during computation of 
20 the cumulative histogram. If such a subtraction is not performed the darkest 
pixel value of the image is not mapped to zero (C 0 *0). Other modifications 
also exist. 

The above equations are usable substantially only if there are as many bins 
25 as signal levels, for example, 256 bins are required for a signal with 8 
bits/sample. If fewer bins are used, each bin contains pixels belonging to a 
certain signal range. The above equations provide mapping function values 
at the borders of bins. Additional values may be obtained by interpolation. 
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Examples of a histogram, a cumulative histogram and corresponding mapping 
function are presented in Figure 1 . 

Using histogram-based pixel mapping techniques, the contrast of an image 
5 can be increased by mapping input pixel values to output pixel values with a 
linear function having a slope (i.e. derivative) greater than one. A slope less 
than one decreases contrast, while a slope equal to one produces no change 
in contrast. The mapping function can also be non-linear, having a varying 
slope. In this case contrast around some pixel values of the image is 
10 increased, the contrast in other pixel value ranges may be decreased or not 
altered at all. An example of a non-linear mapping function is shown in 
Figure 2. 

An acknowledged limitation of histogram-based pixel mapping is that it tends 
15 to make noise and other artefacts disturbingly visible. Because increasing 
contrast increases the visibility of variations in the input signal, if there is noise 
present in the input signal, its visibility is also increased. Because of this, 
histogram-based pixel mapping is often considered unsatisfactory for contrast 
enhancement of natural images. 

20 

Nevertheless, histogram-based pixel mapping is the basis for a substantial 
number of contrast enhancement algorithms. So, whilst these algorithms form 
a mapping function based on the image histogram, attempts are made to 
mitigate the unwanted effects of the basic mapping procedure using 
25 modifications and additions to the basic algorithm. These modifications 
include, for example, reshaping the histogram, reshaping the mapping 
function, filtering the image, the histogram or the mapping function and 
limiting the maximum value of the histogram. 

30 Turning now to edge enhancement, specifically in the context of unsharp 
masking, this is a spatial filtering technique for improving the visibility of edges 
and thus improving perceived image quality. Unsharp masking is commonly 
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implemented in the form of a highpass filter in series with an adjustable gain 
block, as shown in Figure 3. In the illustrated arrangement, a highpass 
filtered and scaled image signal is added to the original image signal as 
shown in Figure 4a. Thus, the desired improvement is achieved by 
5 emphasising high frequency components of the image. Specifically, the output 
of the highpass filter represents a second order derivative of the original 
signal, as represented in Figure 4b. When the highpass filtered signal is 
added back to the original signal, it creates under and overshoots around 
m edges as shown in Figure 4c. The human visual system itself creates similar 

?0 10 under and overshoots around sharp edges. This phenomenon is known as 

the Mach band effect. It demonstrates that the human visual system 
jjf perceives edges in a non-linear manner, and that perception depends not only 

111 on luminance but also on image structure. For this reason, the human visual 

system perceives edges with added under and over shoot, such as those 
|3 15 produced by unsharp masking, as sharper edges. 

j-& 

Unsharp masking also tends to produce some undesirable effects. The 
M presence of a highpass filter makes the system sensitive to noise and 

compression artefacts. Thus, unsharp masking typically produces 
20 perceivable artefacts, which are especially visible in uniform areas of an 
image. 

Accordingly, it has been recognised that in order to improve image quality it 
would be appropriate to modify an input signal of the highpass filter, especially 

25 when there is a noise component present in an image. One such 
modification, known in the art, is to use a standard, predefined, or fixed pixel 
mapping function prior to unsharp masking. Using a conventional fixed pixel 
mapping function, it is possible to emphasise certain edges, whilst limiting 
unwanted noise enhancement. Figure 5 depicts an unsharp masking scheme 

30 that utilises pixel mapping prior to highpass filtering. In the illustrated 
arrangement, a pixel mapping function is applied to the image before unsharp 
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masking in order to limit the unwanted enhancement of noise components 
that occurs as a result of high-pass filtering. 

Figure 6 shows two possible pixel mapping function curves suitable for use 
5 prior to unsharp masking. Curve 1 suppresses high and low level signals and 
stretches mid-range pixel values. Accordingly, in the highpass filter, high and 
low level edges are suppressed and mid level edges are enhanced. In Curve 
2 mid level edges are suppressed and high and low level edges are 

i«i enhanced. In this way, the effect of using pixel mapping prior to highpass 

S 10 filtering is to reduce noise. 

"i ? 

Z The effect of a function such as Curve 1, shown in Figure 6, is illustrated in 

Figure 7. This shows the effect of applying a conventional fixed pixel mapping 
function to an image that contains a single 'edge'. Here the edge is a 
f; 15 transition from dark to light i.e. from very low intensity pixel values to very high 

f_ intensity pixel values. In other words, the image contains just two regions, 

3 one of low luminance values and one of high luminance values, as shown in 

Figure 7a. Figure 7b presents a graph of pixel values created by scanning 
across a row of pixels from left to right. It is assumed that the two regions, 
20 which should be of essentially uniform intensity, exhibit some degree of noise. 
The noise manifests itself as small variations in pixel value (as can be seen 
from the 'ripple' in Figure 7b). By applying the fixed pixel mapping function 
illustrated in Figure 7c, the noise in the image of Figure 7b can be suppressed 
effectively. The result of the fixed pixel mapping function is illustrated in 
25 Figure 7d. The way in which the noise is suppressed can be understood by 
examining the pixel mapping function in detail. It should be appreciated that 
the pixel mapping function describes the way in which pixel values in the 
original image (i.e. that described by Figure 7b) are converted into pixel 
values in the contrast enhanced (adjusted) image, whose pixel value profile is 
30 illustrated in Figure 7d. Considering first reduction of noise in the low intensity 
region of the image, the relevant part of the pixel mapping function is that 
labelled TV in Figure 7c. This part of the pixel mapping function determines 



how low intensity pixel values in the original image are translated into low 
intensity pixel values in the contrast enhanced image. Here the pixel mapping 
function has a gradient less than 1 , indicating that variations in pixel value will 
be reduced (or 'compressed') by applying the function. The same is true in 
5 region of the pixel mapping function of Figure 7c. This part of the curve 
determines the way in which high intensity pixel values in the original image 
are translated into high intensity pixel values in the contrast-enhanced image. 
Thus; noise is effectively reduced at both extremes of the range. Referring to 
how mid-range intensity values are converted by the pixel mapping function in 
,S 10 this example, the part of the function labelled 'C has a gradient greater than 1 
2 and therefore, the range of pixel value variation in this region is actually 

enhanced (expanded or stretched), changing the profile of the transition 
jjS 1 between low and high intensity values. However, this effect cannot be 

m considered as a true sharpening of the transition, such as that provided by 

u 15 unsharp masking. Contrast expansion has the effect of enhancing the 
l2 difference between nearly identical mid-range pixel values and inevitably 

j*f enhances the effect of noise in the pixel value range around the transition. 

The use of conventional fixed pixel mapping functions in order to condition an 
20 image prior to unsharp masking has certain limitations. These will be 
described with reference to Figure 8, which illustrates the effect of using the 
same pixel mapping function, introduced above, to enhance the contrast of a 
second example image. As in the first example, the image considered in 
Figure 8 is a very simple one, comprising two substantially uniform regions, 
25 one darker than the other (Figure 8a). The difference in intensity values 
between the two regions is less than in the previous example, although the 
same kind of noise is present (Figure 8b). The effect of the fixed pixel 
mapping function is illustrated in Figure 8d. While noise in the darker region 
is suppressed, noise in the lighter region is actually enhanced. This effect 
30 occurs because the pixel values of the lighter region correspond to a region of 
the pixel mapping function that has a gradient greater than one. Thus, small 
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differences in pixel value are enhanced, rather than suppressed, causing an 
increase in noise. 

It is common that images are processed using both (fixed or histogram-based) 
5 pixel mapping contrast algorithms and unsharp masking edge enhancement 
algorithms. Referring to Figure 9, the combination of histogram -based pixel 
mapping and unsharp masking can be implemented by placing the histogram- 
based pixel mapping in the original image signal branch before (Option A), 
after (Option C), or in parallel (Option B) with an edge enhancement unit. 

10 Commonly, image processing applications, such as certain commercially 
available software packages, implement options A or C, giving rise to a 
cascaded structure. However, it has been found that the best results are 
achieved by option B, in which a histogram-based pixel mapping unit is placed 
inside the unsharp masking unit, that is in the original image signal branch, in 

15 parallel with the highpass filter and not in cascade with it as in options A and 
C. In option B, any unwanted noise component that is emphasised by 
contrast enhancement, is not highpass filtered and thus not further 
emphasised. In both options A and C the second operation in the cascaded 
structure further emphasises noise artefacts introduced by the first operation. 

20 Here, the second operation refers to the latter operation, i.e. in option A, the 
second operation is unsharp masking, and in option C the second operation is 
histogram-based pixel mapping. Thus, the cascaded approach has the 
disadvantage that noise is 'doubly' enhanced. This can create very annoying 
noise structures, especially if a JPEG or DCT based hybrid codec has been 

25 used to compress the original source image. For example, assuming option A 
is used, initial contrast enhancement causes a certain increase in pixel value 
noise. This is further exaggerated by the following step of edge enhancement 
using e.g. unsharp masking. In the case of option C, because the unsharp 
masking emphasises edges it also heightens noise around edges. The 

30 amplitude of this noise is then further increased by the histogram-based 
contrast enhancement. Also, other artefacts caused by the unsharp masking, 
for example ringing effects may become more visible. The approach 
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illustrated by option B, on the other hand, avoids double noise enhancement. 
Here, contrast and edge enhancement are performed in parallel and the high 
pass filtered image is added to the contrast enhanced image (as indicated by 
the addition symbol in Figure 9). 

5 

Nevertheless, the combined image enhancement options of Figure 9 suffer 
from the problems associated with contrast and edge enhancement previously 
described above. 

1 0 Summary of the Invention 

Against this background, and in one aspect, the present invention resides in a 
method for image enhancement of a digital image comprising a set of image 
pixels, the method comprising applying an inverse histogram-based mapping 
function to the image pixels. 



The inverse histogram-based pixel mapping function can be applied alone, or 
in connection with any of options A, B and C described above. In a 
particularly preferred embodiment, inverse histogram-based pixel mapping is 
applied in connection with option B. 



Alternatively, an inverse histogram-based pixel mapping function is applied in 
connection with any image processing function. Preferably, the inverse 
histogram-based pixel mapping function is applied in connection with an 
image processing function that tends to enhance noise visibility. Most 
25 preferably, the inverse histogram-based pixel mapping function is applied as a 
pre-processing step prior to an image processing function that tends to 
enhance noise visibility. 



30 



In a preferred form of this aspect of the invention, an inverse histogram-based 
pixel mapping step is combined with an edge enhancement step, such as 
unsharp masking. In such an arrangement the inverse histogram-based pixel 
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mapping step improves the performance of the unsharp masking step. It also 
has an advantageous effect on combinations of contrast enhancement and 
unsharp masking techniques. 

5 As explained earlier, unsharp masking techniques augment the subjective 
sharpness of an image by adding overshoot and undershoot components to 
edges within an image. The effect of inverse histogram-based pixel mapping 
is to change the pixel values according to their frequency of occurrence. In 
embodiments in which the inverse histogram-based pixel mapping step is 
10 combined with an edge enhancement step, such as unsharp masking, the role 
of the inverse histogram based pixel mapping is to act as a pre-processor for 
the highpass filter unit inside the edge enhancement unit, that alters pixel 
values in such a way that noise enhancement introduced by subsequent edge 
enhancement is reduced. 

15 

This arrangement serves to minimise the amplificaton of noise components, 
while desired signal components are enhanced. More specifically, inverse 
histogram-based pixel mapping produces a reduction in contrast at signal 
ranges containing a large number of pixels and an increase in contrast 
20 elsewhere. Thus, noise is suppressed in e.g. uniform areas, where it is 
subjectively most visible. It has been found that the effect is substantially the 
same when inverse histogram-based pixel mapping is applied to: a) a large 
uniform area, and b) an area containing a large number of pixels having a 
small number of different values (e.g. a speckled region). 

25 

According to the first aspect of the invention, there is also provided a device, 
such as a portable radio communication device, comprising means for 
performing said image enhancement method. 

30 According to the first aspect of the invention, there is further provided a 
software program, comprising machine readable instructions for causing a 
processor unit to perform said image enhancement method. The first aspect 
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of the invention also extends to a software program product stored on a 
medium and configured to perform said image enhancement method. 

According to a second aspect of the invention, there is provided a method for 
5 image enhancement of a digital image comprising a set of image pixels, the 
method comprising applying, in a branch of an edge enhancement unit that is 
parallel to an original image branch, a histogram-based pixel mapping 
function to said set of image pixels prior to applying a highpass filter in said 
branch. 

10 

As described earlier, use of a fixed pixel mapping function in connection with 
unsharp masking prior to high-pass filtering is known, as illustrated in Figure 
5. This has the disadvantage that such a function can only be chosen to 
enhance contrast in certain pixel value ranges. Furthermore, its effect on 
15 noise components in the image varies according to the nature of the image, 
as evidenced by the description of Figures 7 and 8. Accordingly, the inventors 
have noted that because the function illustrated in Figure 6 is constructed 
artificially it cannot be altered to adapt to image content and is therefore not 
optimal for all images. 

20 

In contrast, the inventors have recognised that because a histogram-based 
pixel mapping function is constructed with reference to the image itself, it is 
adaptive to image content and hence some of the problems relating to noise 
enhancement can be reduced. 

25 

Used in conjunction with edge enhancement, the histogram can be adapted 
such that once a histogram of pixel values within an image has been 
determined, the profile of the histogram may be altered in order to change the 
nature of the pixel mapping function created from it. 

30 
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Brief Description of the Drawings 

Referring now to the accompanying drawings, Figures 1 to 9 are used in 

conjunction with an account of the prior art in which: 

Figure 1 shows a histogram and corresponding mapping function; 

5 

Figure 2 illustrates a non-linear mapping function; 



Figure 3 shows a block diagram of an unsharp masking scheme; 

10 Figure 4 illustrates the effect of an unsharp masking scheme on an edge of an 
image signal; 

Figure 5 shows an unsharp masking scheme with a fixed pixel-mapping unit 
prior to a highpass filter of the unsharp masking scheme; 

15 

Figure 6 illustrates two possible curves of a pixel mapping function of figure 5; 

Figure 7 shows the fixed pixel mapping function applied to an edge in a first 
noisy image; 

20 

Figure 8 shows a fixed pixel mapping function applied to an edge in a second 
noisy image; 

Figure 9 shows possible locations for a contrast enhancement unit. 

25 

The present invention will now be described, by way of example only, with 
reference to the accompanying drawings, in which: 



30 



Figure 10 illustrates one embodiment of the first aspect of the present 
invention; 
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Figure 11 illustrates an inverted histogram constructed according to the 
embodiment of Figure 10; 

Figures 12, 13 and 14a-e show alternative arrangements of the first aspect of 
5 the present invention; and 

Figure 15 shows an embodiment according to a second aspect of the 
invention. 

1 0 Detailed Description of the Invention 

The first aspect of the present invention resides in the provision of an inverse 
histogram-based pixel mapping technique for enhancing a digital image. As is 
well known, a digital image comprises an array of pixels. In the case of a 
monochrome image, each pixel has a pixel value within a certain range (e.g. 0 

15 - 255), which denotes the pixel's luminance. In a colour image, pixel values 
may be represented in a number of different ways. In a commonly used 
representation, referred to as the RGB colour model, each pixel is described 
by three values, one corresponding to the value of a Red colour component, 
another corresponding to the value of a Green colour component and the third 

20 corresponding to the value of a Blue colour component. Numerous other 
colour models exist, in which alternative representations are used. In one 
such alternative model, known as the YUV colour model, image pixels are 
represented by a luminance component and two chrominance or colour 
difference components, each of which has an associated pixel value. 

25 Generally, colour models that employ luminance and colour difference 
components provide a more efficient representation of a colour image than 
the RGB model. It is also known that the luminance component of such colour 
models generally provides the most information about the perceived structure 
of an image. Therefore, application of the present invention may vary 

30 according to the colour model used to represent a particular image. For 
example, in an image represented using the RGB colour model, the method 
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according to the invention may be applied to one, two, or all three colour 
components. On the other hand, if an image is represented using the YUV 
model, it may be more efficient, for example, to apply the method according to 
the invention to just the Y component. However, in general, the method 
5 according to the invention can be applied to all components, or any 
combination (including just one) of the components of a particular colour 
model. Thus, it should be appreciated that the choice of colour model is 
essentially insignificant for application of the invention, as the basic principles 
used to construct the inverse histogram-based mapping function can be 
1 0 applied to any colour model comprising any number of components. 

Whilst this invention can be used in isolation to operate on an image, it has 
been found that it provides particularly beneficial results when used with any 
image processing function that tends to increase noise visibility. The 

15 approach of the present invention, as well as being a method, resides also in: 
a device that includes means for applying inverse histogram-based pixel 
mapping to a digital image. In a specific context, the device may be a mobile 
telecommunications terminal, such as a mobile phone, that has the 
conventional radio frequency, hardware and software means normally 

20 required of a mobile phone and that is equipped with image processing 
capability and / or image capturing and display means. Alternatively, the 
device may simply be a computer equipped with digital image processing 
means implementing the method according to the invention. In the former 
case, the mobile terminal is able to make use of the present invention prior to 

25 transmission of a captured image, and / or for processing received images for 
display on the mobile terminal. 

Referring initially to Figure 10, there is shown one embodiment of an inverse 
histogram-based pixel mapping unit that is provided as a pre-conditioning unit 
30 for a highpass filter unit inside an unsharp masking unit. The inverse 
histogram-based pixel mapping unit is disposed in series with the highpass 
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filter that is inside the edge enhancement unit and both are in a branch or 
loop that is parallel to the original image signal branch. 

The inverse histogram-based pixel mapping function can be formed, for 
5 example, by inverting an image histogram and then subtracting the inverted 
histogram from the maximum value of the original histogram. This method is 
illustrated in Figure 11. A standard histogram is first obtained from an image 
and the maximum value of the histogram is determined. Then, every value in 
the histogram is subtracted from this maximum value. Next, a cumulative 

10 histogram is created. Finally, the inverse histogram-based pixel mapping 
function is derived from the cumulative histogram. After inversion of the 
histogram, the mapping function is formed in a manner analogous to that 
used in the conventional histogram-based pixel mapping method. It should be 
appreciated that the inverse histogram-based pixel mapping function is not an 

15 inverse function in a strict mathematical sense (i.e. f inv (x) * f' l (x) ). 

thus, in one way the formation of the inverse histogram-based mapping 
function comprises the steps of: constructing a histogram of image pixel 
values, optionally processing the histogram, making an inverse histogram 

20 from the histogram, optionally processing the inverse histogram, making a 
cumulative inverse histogram from the inverse histogram, optionally 
processing the cumulative inverse histogram, making an inverse histogram- 
based pixel mapping function from the inverse histogram, optionally 
processing the inverse mapping function, and mapping pixel values using the 

25 inverse histogram-based pixel mapping function. 

The "inversion" can be performed on the cumulative histogram, or 
alternatively it can be applied to the mapping function. For example, 
formation of an inverse histogram-based pixel mapping function may 
30 comprise the steps of: constructing a histogram of image pixel values, 
optionally processing the histogram, making a cumulative histogram, 
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optionally processing the cumulative histogram, making a mapping function 
from the cumulative histogram, optionally processing the mapping function, 
making an inverse mapping function, optionally processing the inverse 
mapping function and, mapping pixel values using the inverse histograrn- 
5 based pixel mapping function. 

In constructing a histogram it is possible that regional histograms could be 
used, i.e. a histogram representing a localised portion of the image. The 
original histogram may be processed or modified before constructing an 

10 inverse histogram. Modifications can also be applied to the inverted 
histogram. In addition, it is also possible to make an inverse mapping function 
from a mapping function derived from the original histogram. It should also be 
noted that the inverse histogram-based mapping function can be applied to all 
the pixels within an image or to a set of image pixels, for example pixels 

15 corresponding to a specific region within an image. 

Because the inverse histogram-based pixel mapping function is derived from 
the inverse histogram via an inverse cumulative histogram, and the 
conventional (non-inverted) histogram-based pixel mapping function is derived 

20 from an image histogram via a cumulative histogram, the inverse histogram- 
based pixel mapping function and conventional histogram-based pixel 
mapping function share a relationship with one another. Therefore, as 
explained above, there are various ways to construct an inverse histogram- 
based pixel mapping function from a conventional histogram-based pixel 

25 mapping function or from a cumulative histogram. For example, if the 
conventional histogram-based mapping function is differentiated, the 
derivative is inverted (in this context the inversion means subtraction from the 
maximum value) and the result is integrated, the obtained mapping function is 
the inverse histogram-based pixel mapping function. 

30 

In an alternative approach, the inverse histogram-based pixel mapping 
function is produced by subtracting each value of a cumulative histogram 
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(formed in a conventional manner) from a value larger than the maximum 
histogram value. Furthermore, adding an offset to the maximum value allows 
limitation of the maximum dynamic range suppression (no zero slopes). 
Other modifications can also be applied to the inverted histogram prior to 
formation of the inverse histogram-based pixel mapping function. What 
should be noted is the principal shape of the inverted histogram compared to 
the original. Peaks in the original histogram are transformed into troughs in 
the inverse histogram and vice versa. In mapping function terms this means 
that regions of high-gradient are transformed to regions of low-gradient and 



*0 10 vice versa. 



Accordingly, the inverse histogram-based pixel mapping function is formed so 
that it has a high slope corresponding to low values in the image histogram 
(i.e. pixel value ranges with a small number of occurrences) and a low slope 

15 corresponding to high values in the image histogram (i.e. pixel value ranges 
with a large number of occurrences). The effect of mapping input pixel values 
to output pixel values using this kind of function is that contrast is reduced in 
signal ranges containing a large number of pixels and increased elsewhere. 
This kind of contrast manipulation decreases the visibility of small variations 

20 and noise in the statistically most important signal ranges. For example, pixel 
value ranges that contain large numbers of pixels typically correspond to 
areas of an image having a substantially uniform intensity or colour. It is in 
precisely these areas that noise, i.e. small variations in pixel value are 
subjectively most visible. 



25 

It has been found that by applying a pixel mapping function constructed from 
an inverse histogram of the image to the image prior to the edge 
enhancement unit of an unsharp masking block, the problem of amplification 
of noise ordinarily caused by unsharp masking is significantly reduced. Noise 
30 amplification is particularly disturbing when a JPEG or DCT based hybrid 
codec has been used to compress the source image, and the present 
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invention has been found to be particularly useful when applied to such 
images. 

Because inverse histogram-based pixel mapping reduces contrast and noise 
5 visibility in statistically important signal ranges, noise enhancement produced 
by unsharp masking is also reduced at these signal ranges. This has an 
advantageous effect, for instance, when the image contains a relatively wide 
and smooth area. Such an extensive smooth area gives rise to. a 
concentration of high values in the image histogram. Inverse histogram- 

10 based pixel mapping has the effect of reducing noise amplification due to 
subsequent unsharp masking, particularly in such a large and smooth area. 
Elsewhere the unsharp masking sharpens edges without restrictions. Thus, 
while edges are suppressed in one part of the dynamic range e.g. for pixel 
values representing a large smooth area, they are enhanced elsewhere in the 

15 dynamic range. Therefore "real edges" between regions; are enhanced 
without restrictions. 

As previously explained, image processing operations often include both 
unsharp masking and a histogram based pixel-mapping algorithm for contrast 
20 enhancement. In this case, it has been found that application of the method 
according to the present invention significantly improves the resulting picture 
quality. Inverse histogram-based pixel mapping reduces noise amplification in 
the areas of the image that are emphasised by the contrast enhancement 
algorithm. Due to this feature, both algorithms do not enhance the noise. 

25 

Figure 12 shows an example of an implementation of the present invention in 
which inverse histogram-based pixel mapping is used in conjunction with 
conventional histogram-based pixel mapping contrast enhancement and 
unsharp masking. A conventional histogram-based pixel mapping contrast 
30 enhancement unit is placed in the original image branch of the unsharp 
masking unit, and a combination of an inverse histogram-based pixel-mapping 
unit and an unsharp masking unit is placed in a branch that is parallel to the 
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original image branch. The output of the parallel branch is added to the 
output of the histogram-based pixel mapping contrast enhancement unit. 

Figure 13 shows a modified arrangement in which an additional (low-pass) 
5 filtering block added in the original image branch (into the upper path), after 
the contrast enhancement operation. The purpose of the filtering block is to 
reduce the noise introduced by conventional histogram-based contrast 
enhancement. 

10 A second aspect of the invention is depicted in Figure 15, in which there is 
provided a histogram-based pixel mapping unit alongside and prior to an 
unsharp masking unit in a branch of an image enhancement arrangement, the 
branch being parallel to the original image branch. The output of the parallel 
branch is added to the original image. With this arrangement because the 

15 mapping function adapts to the image content, noise enhancement has been 
found to be reduced. 

The present invention may also be applied for enhancement of digital video 
sequences, in which case it is advantageous to add temporal processing to 

20 the histogram. A video signal consists of a sequence of digital images. Each 
image can be enhanced individually, but the same histogram cannot be used 
for two images that have different content. This means that histograms are 
preferably gathered for each image. However, processing images in the video 
sequence individually produces disturbing flicker, because even quite 

25 unnoticeable visual differences can cause two images to have substantially 
different histograms. Therefore, temporal processing, for example low pass 
filtering, of the histograms is needed. Typically this kind of processing is 
adaptive to sudden large changes in image characteristics, for example due to 
scene-cuts. 

30 

The present invention may be embodied in other specific forms without 
departing from its essential attributes. The inverse histogram-based pixel 
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mapping function of the present invention has been described above in the 
context of a pre-processor for an edge enhancement function. However, the 
present invention may be used on its own or in a variety of different ways. 
Figure 14 illustrates a number of different applications of an inverse 
5 histogram-based mapping function unit. Figure 14a shows the inverse 
histogram-based mapping unit applied on its own to an image. Figure 14b 
shows the inverse histogram-based mapping unit as a post-processing unit for 
an edge enhancement unit. Figure 14c shows the inverse histogram based 
mapping unit as a pre-processing unit for an edge enhancement unit. Figure 

10 14d shows an inverse histogram-based mapping unit in parallel with an edge 
enhancement unit. Figure 14e shows two inverse histogram-based mapping 
units, one in an original image branch and used as a pre-processing unit for a 
low pass filter, and the other one in a parallel branch, as a pre-processing unit 
for an edge enhancement unit. Other inverse histogram-based mapping 

15 arrangements are possible, in which the method comprises applying the 
image's statistical data-dependent pixel mapping function to the image pixels 
in such a way that image contrast is reduced in signal ranges containing a 
large number of pixels and increased in other signal ranges. 

20 Accordingly reference should be made to the appended claims and other 
general statements herein rather than to the foregoing specific description as 
indicating the scope of invention. 

Furthermore, each feature disclosed in this specification (which term includes 
25 the claims) and/or shown in the drawings may be incorporated in the invention 
independently of other disclosed and/or illustrated features. In this regard, the 
invention includes any novel features or combination of features disclosed 
herein either explicitly or any generalisation thereof irrespective of whether or 
not it relates to the claimed invention or mitigates any or all of the problems 
30 addressed. 
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The appended abstract as filed herewith is included in the specification by 
reference. 




